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I. ARE THERE UNCERTAINTIES THAT ARE NOT RISXS? 

There has always been a good deal of skepticism about the behavioral 
significance of Frank Knight's distinction between "measurable uncertainty" o 
"risk," which nay be represented by numerical probabilities, and "unmeasurab' 
uncertainty" which cannot. Knight nalntalned that the latter "un rtalnty" 
prevailed -- and hence that numerical probabilities were Inapplicable -- in 
situations when the deciaion-naker was ignorant of the statistical freque. - 
cies of events relevant to hi a decision; or when a priori calculations were 
impossible; or when the relevant events were in some sense unique; or when a: 
important, once-and-for-all decision was concerned.^ (For this and subseque 
footnotes, see end of paper.) 

Yet the feeling has persisted that, even In these situations, people ten 
to behave "as If" they asslgied numerical probabilities, or "degrees ol 
belief," to the events iqpinging on their actions. However, it is hard eithe 
to confirm or to deny such a proposition In the absence of precisely-defined 
procedures for measuring these alleged "degrees of belief." 


« 

Any views expressed In this paper are those of the author. They should 
not be Interpreted as reflecting the views of The RAND Corporation Or the 
official opinion or policy of any of its governmental or private research 
sponsors. Papers are reproduced by The RAND Corporation as a courtesy to 
members of it3 staff. 

Research for this paper was done while the author wa3 a member of the 
Society of Fellows, Harvard University, 1957* An earlier version was read 
before the Econometric Society at its December i960 meeting In St. Louis; 
and the present version incorporating changes In Section III will appear in 
the November 1961 issue of the Quarterly Journal of Economics , in a sycposluc 
on decision-making under uncertainty, together with a contribution by 
William Fellner and a note on the present paper by Howard Rolffa. I 11 re¬ 
vising Section III, the author was particularly stimulated by discussions 
with A. Madanaky, T. Schelling, L. Shapley, and S. Winter. 
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What might it own operationally, In tern* of refutable predictions about 
observable phenomena, to say that someone behaves "as if" he assigned quanti¬ 
tative likelihoods to events: or to say that he does not? An intuitive 
answer may emerge if we consider an example proposed by Shackle, who takes 
an extreme form of the Khigbtian position that statistical information on 
frequencies within a large, repetitive class of events is strictly irrelevant 
to a decision whose outcome depends on a single trial. 3hackle not only 
rejects numerical probabilities for representing the uncertainty in this 
situation; be maintains that in situations where the potential outcomes 
seem "perfectly possible" in the sense that they would not violate accepted 
lavs and thus cause "surprise," it is impossible to distinguish meaningfully 
(i.e., in terms of a person's behavior, or any other observations) between 
the relative "l ik eli h oods" of these outcomes. In throwing a die, for instance, 
it would not surprise us at all if an ace came up on a single trial, nor if, cr 
the other hand, sane other ouster osne 19. 80 M&ackle concludes: 

3 uppose the captains In a Test Match hove agreed that Instead of 
tossing a coin for a choice of Innings they will decide the 
matter by this next throw of a die, and that If It shows an ace 
Australia shall bat first, If any other number, then Zhgland 
shall bat first. Can ve now give any meaningful answer whatever 
to the question, "Who will bat first?" except "We do not know?" 2 

Most of us might think ve could give better answers than that. We could 

say, "fcigland will bet first," or more cautiously: "1 think England will 

probably bat first." And If Shackle challenges us as to what ve "mean" by 

that statement, it Is quite natural to reply: "We’ll bet on England; and 

we'll give you good odds." 

It so happens that in this case statistical information (on the 
behavior of dice) is available and does seer, relevant even to a "single 
shot" decision, our bet; it will affect the odds we offer. As Damon Runycn 
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once said, "The race Is not always to the swift nor the battle to tbe 
strong, but that's tbe way to bet." However, It is our bet itself, and not 
the reasoning and evidence that lies behind it, that gives operational 
meaning to our statement that ve find one outcome "more likely" than 
another. And we may be willing to place bets -- thus revealing "degrees 
of belief" in a quantitative form — about events for which there is no 
statistical information at all, or regarding which statistical information 
seems in principle unobtainable. If our pattern of bets were suitably 
orderly — if it satisfied certain postulated constraints -- it would be 
possible to infer for ourselves numerical subjective probabilities for 
events, in terms of which same future decisions could be predicted or 
described. Thus a good deal — perhaps all -- of Knight *g class of 
"unmeasurable uncertainties" would have succumbed to measurement, and 
"risk" would prevail instead of "uncertainty." 

A number of sets of constraints on choice-behavior under uncertainty 
have now been proposed, all more or less equivalent or closely similar in 
spirit, having the intdicatton that — for a "rational" man — all uncer¬ 
tainties can be reduced to risks .^ Their flavor is suggested by Ramsay’s 
early notions that, "The degree of a belief is.. .the extent to which we 
are prepared to act upon it," and "The probability of 1/3 Is clearly 
related to the kind of belief which would lead to a bet of 2 to 1."^ 
Starting from the notion that gambling choices are influenced by, or 
"reflect," differing degrees of belief, this approach sets out to infer 
those beliefs from the actual choices. Of course, in general those choices 
reveal not only the person's relative expectations but his relative prefer¬ 
ences for outcomes; there is a proDiem of distinguishing between these. 



tut If one pick* the right choices to observe, and If the Savage postulates 
>r some equivalent set are found to be satisfied, this distinction can be 
ade unambiguously, and either qualitative or, Ideally, numerical proba¬ 
bilities can be determined. The propounders of these axioms tend to be 
topeful that the rules will be commonly satisfied, at least roughly and 
cat of the time, because they regard these postulates as normative maxims, 
ldely-acceptable principles of rational behavicr. In other words, people 
hould tend to behave In the postulated fashion, because that Is the vay 
hey would want to behave. At the least, these axioms are believed to 
redlct certain choices that people will make when they take plenty of 
lme to reflect over their decision, In the light of the postulates. 

In considering only deliberate decisions, then, does this leave any 
oaxn at all for "unmeasurable uncertainty": far UDeertulntiee not reduc- 
ble to "riska," to quantitative or qualitative probabilities? 

A side effect of the axiomatic approach la that It supplies, at last 
as Khlgbt did not), a useful operational meaning to the proposition that 
eople do not always assigned, or act "as though" they assigned, probabili¬ 
ties to uncertain events. The meaning would be that with respect to 
ertain events they did not obey, nor did tney wish to obey -- even on 
■e flection — Savage's postulate* or .>qulvalen, rules. One could emphasize 
ere either that the postulates fn 4 'cd to bu acceptable in those circum- 
tar.ee* as normative rules, or that they failed to predict reflective 
holces; I tend to be more Interested In the latter aspect, Savage no 
oubt In the former. (A third Inference, which H. Half fa favors, could be 
hat people need more drill on the Importance of conforming to the Savage 
xiotas.) But from either point of view, It would follow that there would 
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bt simply no wy to Infer meaningful probabilities for those events from 

their choices , and theories which purported to describe their uncertainty 
In tents of probabilities would be quite Inapplicable In that area (unless 
quite different operations for measuring probability were devised). More* 
over, such people could not be described as maximising the mathematical 
expectation of utility on the basis of numerical probabilities for those 
events derived on any basis. Nor would it be possible to derive numerical 
"von Neumann-Morgenstern' utilities from their choices among gambles 
involving those events. 

I propose to Indicate a class of choice*situations In which many 
otherwise reasonable people neither wish nor tend to conform to the 
Savage postulates, nor to the other axiom sets that have been devised. 

But the Implications of such a finding, If true, are not wholly destructive. 
First, both the predictive and normative use of the Savage or equivalent 
postulates might be improved by avoiding attempts to apply them In certain, 
specifiable circumstances where they do not seem acceptable. Second, ve 
might hope that It is precisely in such circumstances that certain 
proposals for alternative decision rules and nan-probabilistic descriptions 
of uncertainty (e.g., by Khlght, Shackle, Burvlcz, and Bodges and Lehmann) 
might prove fruitful. I believe, in fact, that this is the case. 
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FOOTNCTES 

^ Knight, F. H., Risk, Uncertainty and Profit , Houghton Mifflin Co., 
Boston, 1921. But see Arrow*a comments: "In brief, Knight' s uncertain¬ 
ties seen to have surprisingly many of the properties of ordinary 
probabilities, and it is not clear how much is gained by the distinction 
. . • .Actually, his uncertainties produce about the same reactions in 
individuals aa other writers ascribe to risks.” Arrow, K. J., 

"Alternative Approaches to the Theory of Choice in Risk-taking Situation," 
Econonetrlca , Vol. 19, October 1951, pp. **17; **26. 

2 

Shackle, G. L. S., Uncertainty in Economics (Cambridge 1955)» 
p. 5. if tills exarple were not typical of a number of Shackle’s work, 

It would seen almost unfair to cite it, since it appears so transparently 
inconsistent with coiaronly-observed behavior. Can Shackle really believe 
tiiat an Australian captain who cared about batting first would be 
indifferent between staking this outcome on "heads" or on an ace? 

^ Ramsey, F. P., "Truth and Probability" (1926) in The Foundations 
of Mathematics and Other Logical Essays , London, 1931; Savage, L. J., 

The Foundations of statistics , New York, 1951; de Finetti, E., "Recent 
f-ggc-stions for the Reconciliation of Theories of Probability,'' pp. 217- 
of Proceedings of the Second (1950) Berkeley .tymposlun on Mathematical 
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Statistics <ad Probability. Berkeley, 1951; Buppes, P. (see Buppee, P., 
Davidson, D., sol Siegel, 8., Dad sloe-Making, Ttsnford, 1957)* Closely 
RBUfcted approaches. In which individual choice behavior Is presumed to be 
stochastic, have been developed by Luce, R. 0., Individual Choice Behavior, 
Bsv York, 1959, and Chipmsn, J. 8., "Stochastic Choice and Subjective 
Probability," In Decisions, Values and Oroqpa, ed. Winner, D., Hew York, 
I960. Although the argument In this paper applies equally veil to these 
latter efeochestlc axiom systems, they vlll not be discussed explicitly. 



** Op. clt ., p. 21. Savage notes that the principle, in the form ">f 


the rationale above, "cannot appropriately be accepted as a postulate In 
the sense that PI is, because it vould Introduce nev undefined technical 
terms referring to knowledge and poaalblllty that vould render it mathe¬ 
matically useless without still more postulates governing these terr.*." 

Be substitutes for it a postulate co r respo n ding to P2 above as expressing 
the earn Intuitive constraint. Savage's P2 corresp on ds closely to 
"Rubin's Postulate" (Luos and Ralffs, Qaass and Decisions, Nev York, 1957, 
p. 290) or Minor's "Colossi Linearity" postulate, Ibid ., p. 297 , which 
lsply that adding a constant to a column of payoffs should not change the 
preferance ordering among acts. 

If numerical probabilities vers assumed known, so that the subject 
vers dealing explicitly vlth known "risks," these postulates would amount 
to Samuel son's "special Independence Assumption” ("Probability, Utility, 
and the Independence Axiom," Bcononetrlca , 20 , 670-70, 1952) on which 
Soasielson relies heavily In his derivation of "von Neunann-Morgenstern 
unities." 
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6 I bet. 

^ Note that in no case are you Invited to choose both a color and an 
urn freely; nor are you given any Indication beforehand as to the full set 
of gambles that will be offered. If these conditions vere altered (as in 
some of fi. R&lffa's experiments with students), you could enploy randomised 
strategies, such as flipping a coin to determine what color to bet on in 
Urn I, vhich might affect your choices. 

O 

Bare we see the advantages of purely hypothetical ex perim en ts, m 
"real life," you would probably turn out to have a profound color prefer¬ 
ence that would invalidate the whole first set of trials, and various 
other biases that would show up one by one as the experimentation 
progressed inconclusively. 

H owe v er, the results in CM jean's almost identical experiment (op . 
clt., pp. 87 - 86 ) do give strong support to this finding; Chlpaan's 
explanatory hypothesis differs from that prspossd below. 

^ m order to relate these ehoioes dearly to the postulates, let us 
change the experimental setting slightly. Let us assume that the balls In 
Urn I are each marked with e I, end the balls in Urn II with a II; the 
contents of both urns are then dusg>ed Into a single urn, which then con¬ 
tains 50 Hed^j balls, ^0 Blacky balls, and 100 Red I and Black t balls in 
unknown proportion (or in a proportion indicated onl; by a small random 
sanple, say, one Red and one Black). The following actions are to be 


considered: 
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100 50 50 

r~ » 

"i ®i *n *n 

lab b b 

II b a b b 

m b b a b 

IV b b b a 

V a a b b 

VI b b a a 


Lrt ua aasune that a pereon la indifferent between I and II (between 
batting on Rj or B^), between HI and IV and between V Kid VI. It would 
than follow froa Postulates 1 and 2, the assumption of a complete ordering 


of action* and the Sure-thin*; Principle, that I, II, III and IV are all 


Indi ff eren t to each otter. 

To lndloate the nature of the proof, cuppoae that I la preferred 
IIZ (the peraon prefer# to bat on Rj rather than R^). Postulates 1 and 2 
ltely that certain Uunafona&lons oan be parforned on this pair of action* 


without affection ttelr nr ef e r enoe ordering; specifically, one action can 
be replaced by an action Indifferent to It (PI — complete ordering) and 
the value of a constant colussi oan be changed (P2 — Sure-thlng Principle) 


Thus starting vith I and IH and performing such "adaissible tra~ 
format lonV It would follow from PI and PS that the first action in each of 
tbs following pairs should be preferred: 
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*n 

*XX 

*11 


I 

a 

b 

to 

b 


m 

to 

to 

a 

b 


i» 

a 

to 

t> 

a 

PS 

nr 

to 

to 

a 

a 


i" 

a 

to 

b 

a 

PI 

m" 

a 

a 

b 

b 


r M 

b 

to 

b 

a 

PS 


to 

a 

b 

b 


j» #»t 

b 

to 

a 

b 

PI 

m***' 

a 

to 

b 

b 



Contradlct loo: 1 preferred to IH, and I"" (equivalent to III) 

preferred to HI***' (equivalent to i). 

10 ltaigfct, op. dt .. p. 219. 

U Kenneth Areo* bee augpeeted the fallowing ex a nyle , in the eplrlt 
of the eheve one: 

JgO 90 50 

*1 *x *n *xx 

Z e e h to 

XX e to a to 

IS to e to e 

Xf to to e e 

Aeeuae that X la Indi f f er e nt to XV, II la Indifferent to 1C. 

Juppose that X la preferred to IX; vtet la the ordering of XII and IV? 

If III la not preferred to IV, fC, the Sure^thlng Principle la violated. 

If IV la not preferred to HI, PI, complete ordering of actlona, la 

violated. (If III la Indifferent to IV, tooth VI and P2 are violated.) 

12 

Let the utility pa y of f a ooneapoodlng to $L00 and |0 be 1, 0; let 
P l' P 2' P j Pfobabilltiaa oo r raap on dlng to Red, Yellow, Black. The 

expected value to action I is then P^j to II, P^; to HI, + Py to 
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IV, 4 fy But than art no PP^ > o, IP^ • I, seeh that P, > P g 
mA ?i 4 p ? < p g 4 P^. 

15 lam. P., "Probability aad tha Attaapts to Nmmtb Utility," 
ft» Iwiwt c Brrlvw (Tokyo, Japan), July 1950, pp. 169-170. 

Vo taat tha predictive affect! vane sa of tha arlnaa (or of tha alter¬ 
nate decision ruin to be propound In tba oart aactlon) In thaao situations 
ooptroliad experimentation la In order. (Ban Chlpaac'a lnganious experlaei 
ag>. dt .) But, aa Baraga raaarka (a. cit., p. 26 ) , tha node of lotanogi* 
tlon ImpHad hart and In Savage's book, asking "tha person not how he f*-->.• 
but abet he would do In such and aueh a situation" and gtrla^ bin ■gtla 
opportunity to pondar tha lMplinetlcna at hla repllaa, aaana quite appropr" • 
ate In uniting "the theory's aore fc^ertant noreatlee Interpretation.' 

ibeervatlons can have at least negative 
there la e premagtloo that people 
Ml flgvngi Ttnma, and who claim upon further 
reflection that they 4e aot Mrt to «hey than, do not tend to obey then 
wily in auch dtoteUM. 

14 Ba ana Mom dart dona tan baead on "regrets" oould violate the 
Bure thing Principle, dnoe ell oanetant ooltaaia of pqroffs would trensfom 
to e 00 loan at O'a in terns at "regret"; on the other hand, such a parson 
vould violate PI, ooMpieta ordering of strategies. 

flea CM fan, 0 £. dt .. pp. 75. 93. Chipaan'a important work in 
till a area, dona Indapandeotly and largely prior to nine, la not discueasd 
here aloes It eMbodles e stochastic theory of choice; lta spirit is 
otherwise closely similar to that of the present approach, and hla experi¬ 
mental results are both pertinent and favorable to the hypotheses below 
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(tbon^i CUfMi'i IsHuwhu vi icwitet diXIUmt) « 

8m also tbs oaMBti by Owrpiett<8oipa an notion of 

* oonospt Identical to "■Mprtty" la this paper: Tbe 
totaca of to pe e t atien and Oboertala^r," la topectatlons. Uboertalnty. and 
Bnalnem tobarlor. ed. Mazy Bdov, M od a l S ci e nce Resear ch Council, 
fev York, 1958, pp. 24-26; and Thdoe, topectatlons «A M ms ur a Mlt ty," 
Quarterly Journal oc knoalc i, Mel. XXVXXX, to. 4, ftmabtr 1954* 
pp. 527-550. too— >»4My pertinent artlclaa qm to ay attention only 
after this paper had pane to the printer, el lariat no %eoa fbr ooaanot 
ban. 

^ imp, 2 * dt.. pp. 57-58* 59 . torapi latar poaa ao far ea to 
auegaat (qp. dt.. pp. l£B-l£9) tost the "aura of TapasneM" a tt ac h ed to 
aangr Judpvata of pereaaal p9MAU% Ml#* lead to piMMttc violations 
of da artii, althouto tht Aaalalao rule ha Aloeaoooo oa alternative— 

the behavior u our emoploo. 

17 fel#t, *. H|.» »• iff. 

^ fda obbMULoU too oooofttooo tqr ffhlj —1 (qp. dt.. p. 08 ) and 
Oeoifo c u to— (ThoAee, tt pi rttoH as aed Me a su r a b ility," pp. 537-550), 
md "Tbs totort of topetodo* mA IBia artel nty," p. 85) toot ladleiduals 
order uncertainty-eltn adnpo IPlOjipItMlU In tame of iitleatil 

expectation and "credibility" (vibipdty); aMlpilty Ypt 1 * 1 to lnf lutn ct 
cbolca am vhan aatiaated expectetlona are not equivalent. 

IQ 

This rule la b eaad upon the ooooep t of e "reatrlcted Bayes 
solution" davelopad by J. L. Bodges, Jr., and X. L. Lebaaon ('The Uses of 
Previous toperlanoe in Reaching Statistical Decision," enn»i« of 
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Hath—M Tl Btetletlne, M. 23, Bo. 3, BtpUmbmr, 1932, ». >96-407. 
The (IfariMOlnn thxm^mst Section ZH of this p apor derives hsacvlly fWn 
tha kifM mA latMB aifwot, aZttaoutfx their approach la eotirsfced and 


Bee also, L. Bomlea, "Bom ^pacification ProMa— and Appli c a t ions 
to Isooc— t rie Models," jSBBBSHS $* fo1 ' 19 ’ 3» 1951, PP- 

343-344 (abetmet). This deals nth the oc sort of ptohlea and praeants 
a "paaarallsad l^ aa nlnlnar principle" efulvalsot, In sore fanerml fans, 
to the decision rule Z propoeoA In an ea rl i er weeantetlon of this paper 
(Beea^er, I960) ; hot both of these Inched the crucial notions developed 
In the Badass and Lriaaam approoeh of a "beet eetlnate" distribution y° 
ad a "oanfldanee" pwnlir 

I^padada or jeilBm ruin adwsnosd Minor in tbs aooanpanylu* 
tftialn in tbU ^nposdna« ftltnar aoans sniiWhUy to bs dealing with 
Mas mm yknwnn dCnosooad bale, and his proposed teetanlfue of asa au rlng 
a paroaa's edfcjietivs yHhiiUttH and utilities is relatively 
"uMBMfnai' attmtUns mA Ban eolag these aaseurmanta to oollbrafee 

aoarsa of am dnto and hypodfceeee. Nmoovut, his des cr i pt ive data and 
intuitive eoajeeturae lend mental sqpport to ttas flndiac* reported 
tart. Bou evar , his eolation to the problan opposes a si n g l e set of 
uaiBits deteruined Indep e nd e n tly of payoffs (preeuaably oorxe ^ponding to 
tte "beet estlaates" here) and a "correction factor," reflecting the 
degree of mblguity or oonfldanoe, vhich operates on these weights In a 
aauar Independent of the structure of paoroffs. I m not entirely clear 
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aa the betwrioorml ixpUcmtlons of Mloer'c aodel or thr decision rule It 
liqpl*ee, Uut in rise of theee properties I so doubtful ubether it can 
neoouot «V*q-j*tsly for all the behavior diocusasd above. 







